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WHAT IS CLAIMED IS: 

1 1 . A method comprising: 

2 deteramiing an orientation of a camera associated with a first image based on a shape 

3 of a perimeter of a corrected version of the first image, wherein the corrected version of 

4 the first image^as less perspective distortion relative to a reference image than the first 

5 image and the snape of the perimeter of the corrected version of the first image is 

6 different from the shape of the perimeter of the first image; and 

7 projecting the firsrt image on a surface based on the orientation of the camera 

8 associated with the firs^ image. 

1 2. The method of claim 1 furti^q- comfprisinR/ 

2 determining a focal |engtlwi a capawa associated with the first image based on the 

3 shape of the perimeter of the Qp^^cted version of the first images, wherein the step of 

4 projecting the first image is furthet based on the focal length. 

1 3. The method ofVaim 1, further comprising: 

2 projecting theSreference image on the surface. 

1 4. The method of clainrG further comprising: 

2 merging the projected reference image and the projected first image to form a 

3 panoramic image. \ 

1 5. The method of claim 3 furtnfer comprising: 

2 projecting a three-dimensiVial object onto the surface; 

3 merging the projected three-iiimensional object, the reference image and the first 

4 image to form a panoramic imageX 

1 6. The method of claim 1 wherein the surface is cylindrical. 

1 7. The method of claim 1 wherein the surfao^e is spherical. 

1 8. The method of claim 1 wherein the surface f^planar. 
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1 9. The method of claim 1 further comprising: 

2 determining an onentation of a camera associated with a second image based on a 

3 shape of a perimeter oi a corrected version of the second image, wherein the corrected 

4 version of the second iipage has less perspective distortion relative to the reference image 

5 than the first image; and \ 

6 projecting the second image on the surface based on the orientation of the camera 

7 associated with the second image. 

1 10. The method of claim 2 whereimdetermining the focal length and rotation angle further 

2 comprises: \ 

3 selecting initial values for the o\rientation and the focal length; and 

4 improving the accuracy of the selected values of the orientation and the focal length 

5 by: \ 

6 estimating the shape of the perimeter of the corrected version of the first 

7 image based on the selected values of thaorientation and the focal length; 

8 comparing the estimated shapeVnd the actual shape of the perimeter of the 

9 corrected version of the first image; \ 

10 adjusting the selected values of tha orientation and the focal length based on a 

1 1 difference between the estimated shape and theWtual shape of the perimeter of the 

12 corrected version of the first image. \ 

1 11. The method of claim 10 wherein improving the accuracy of the selected values of the 

2 orientation and the focal length further comprises: \ 

3 computing a difference between the selected values of the orientation and the focal 

4 length with the adjusted values of the orientation and tha focal length; 

5 if the computed difference is below a threshold value:\ 

6 determining that the adjusted values of the orienmtion and the adjusted value 

7 of the focal length are the actual orientation and the actual foWl length; 

8 otherwise, if the computed difference is not below the threshold value: 

9 selecting the adjusted values of the orientation and the focal length as the 
10 values of the orientation and the focal length; and \ 
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1 1 repeating the step of improving the accuracy of the selected values of the 

,12 orientation and the focal length. 

1 12. The method of claim 10 wherein tha initial value of the orientation is selected to be an 

2 orientation of a camera associated wim the reference image. 

1 13. The method of claim 1, wherein the orientation of the camera associated with the first 

2 image is measured relative to an orientatio\of a camera associated with the reference 

3 image. 

1 14. The method of claim 10 wherein the initial value^of the focal length is selected based on a 

2 measurement of the first image. 

1 15. The method of claim 14 wherein the selected initial v^ue of the focal length is the sum of 

2 a length and a width of the image. 

1 16. The method of claim 10 wherein a Newton's iteration is us\d to adjust the initial values 

2 of the rotation angle and the focal length. 

1 17. The method of claim 1 whe^emXhe orientation comprises a rotation angle of the camera. 

1 18. The method of claim 1 wherein the reference image is an image of a reference segment of 

2 a view and the first image iV an image of a first segment of the view that overlaps the 
reference segment of the vie wi the method further comprising: 

correcting for perspective distortion in the first image relative to the reference image 
to generate the corrected version W the first image. 

19. The method of claim 18 further comprising: 
determining a position offset of the^irst segment of the view relative to the reference 

segment of the view, wherein correcting^or perspective distortion is based on the 
determined position offset 

20. The method of claim 18 wherein the perimete\of the first image includes at least a first 
reference point and a second reference point and correcting for perspective distortion 
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3 alters the shape of the perimeter of the first image by moving the first reference point 

4 relative to the second reference point. 

1 21 . The method of claim 20 M^herfein the first and second reference points are vertices defined 

2 by the shape of the perimeter oiSthe first image. 

1 22. The method of claim 2 1 wherein tnfe shape of the perimeter of the first image is 

2 rectangular and correcting for perspective distortion alters the shape of the perimeter of 

3 the first image into a trapezoid. \ 

1 23. The method of claim 1 wherein determining the orientation is further based on the shape 

2 of the perimeter of the first image. \ 

1 24. The method of claim 1 wherein the perimeter orthe first image has the same shape as the 

2 perimeter of the reference image. \ 

1 25. An article comprising a machine-readable medium omwhich are tangibly stored machine- 

2 executable instructions the stored instructions being opetable to cause a machine to: 

3 determine an orientation of a camera associated with asfirst image based on a shape of 

4 a perimeter of a corrected version of the first image, whereiikthe corrected version of the 

5 first image has less perspective distortion relative to a reference image than the first 

6 image and the shape of the perimeter of the corrected version of\he first image is 

7 different firom the shape of the perimeter of the first image; and \ 

8 project the first image on a surface based on the orientation of thexamera associated 

9 with the first image. \ 

1 26. The article of claim 25 wherein the^netruca^^ cause the machine to: 

2 determine a focal length of a^cameripssoci^rted with the first image based on the 

3 shape of the perimeter of the corrected^gwrion of the first images, wherein the step of 

4 projecting the first image is further based o^ the focal length. 

27. The article of claim 25 wherein the instructions further cause the machine to: 
project the reference image on the surface. 
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1 28. The articled claim 27 wherein the instructions further cause the machine to: 

2 merge thea)rojected reference image and the projected first image to form a 
panoramic image. 

1 29. The article of claim 27 wherein the instructions further cause the machine to: 

2 project a three-dknensional object onto the surface; 

3 merge the projected three-dimensional object, the reference image and the first image 

4 to form a panoramic image. 

1 30. The article of claim 25 wherein the surface is cylindrical. 

1 31. The article of claim 25 whereiri the surface is spherical. 

1 32. The article of claim 25 wherein the surface is planar. 

1 33. The article of claim 25 wherein the instructions further cause the machine to: 

2 determine an orientation of a cameta associated with a second image based on a shape 

3 of a perimeter of a corrected version of me second image, wherein the corrected version 

4 of the second image has less perspective oistortion relative to the reference image than 

5 the first image; and \ 

6 project the second image on the surface based on the orientation of the camera 

7 associated with the second image. \ 

1 34. The article of claim 26 wherein determining the focal length and rotation angle further 

2 comprises: \ 

3 selecting initial values for the orientation and the focal length; and 

4 improving the accuracy of the selected values of the (mentation and the focal length 

5 by: \ 

6 estimating the shape of the perimeter of the correWd version of the first 

7 image based on the selected values of the orientation and the meal length; 

8 comparing the estimated shape and the actual shape of the perimeter of the 

9 corrected version of the first image; \ 

10 adjusting the selected values of the orientation and the focal length based on a 
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1 1 difference between me estimated shape and the actual shape of the perimeter of the 

12 corrected version of tne first image. 

1 35. The article of claim 34 wWrein improving the accuracy of the selected values of the 

2 orientation and the focal length further comprises: 

3 computing a difference between the selected values of the orientation and the focal 

4 length with the adjusted values Vf the orientation and the focal length; 

5 if the computed difference is 5elow a threshold value: 

6 determining that the adjusted values of the orientation and the adjusted value 

7 of the focal length are the actual orientation and the actual focal length; 

8 otherwise, if the computed differencfe is not below the threshold value: 

9 selecting the adjusted values ol^the orientation and the focal length as the 

10 values of the orientation and the focal length: and 

11 repeating the step of improving the\^accuracy of the selected values of the 

12 orientation and the focal length. 

1 36. The article of claim 34 wherein the initial value of me orientation is selected to be an 

2 orientation of a camera associated with the reference Image. 

1 37. The article of claim 25 wherein the orientation of the camera associated with the first 

2 image is measured relative to an orientation of a camera associated with the reference 

3 image. 

1 38. The article of claim 34 wherein the initial value of the focal len^h is selected based on a 

2 measurement of the first image. 

1 39. The article of claim 38 wherein the selected initial value of the focal length is the sum of 

2 a length and a width of the image. 

1 40. The article of claim 34 wherein a Newton's iteration is used to adjust the injtial values of 

2 the rotation angle and the focal length. 



41 , The article of claim 25 whe 



ition comprises a rotation angle of the camera. 
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1 42. The article of claimYS wherein the reference image is an image of a reference segment of 

2 a view and the first image is an image of a first segment of the view that overlaps the 

3 reference segment of tne view, the instructions ftirther causing the processor to: 

4 correct for perspective distortion in the first image relative to the reference image to 

5 generate the corrected version of the first image. 

1 43. The article of claim 42 whereiii the instructions further cause the machine to: 

2 determine a position offset W the first segment of the view relative to the reference 

3 segment of the view, wherein correcting for perspective distortion is based on the 

4 determined position offset \ 

1 44. The article of claim 42 wherein the perimeter of the first image includes at least a first 

2 reference point and a second reference Roint and correcting for perspective distortion 

3 alters the shape of the perimeter of the fiist image by moving the first reference point 

4 relative to the second reference point. \ 

1 45. The article of claim 44 wherein the first and sV;ond reference points are vertices defined 

2 by the shape of the perimeter of the first image.X 

1 46. The article of claim 45 wherein the shape of the perimeter of the first image is rectangular 

2 and correcting for perspective distortion alters the sftape of the perimeter of the first 

3 image into a trapezoid. \ 

1 47. The article of claim 25 wherein determining the orientation is fiirther based on the shape 

2 of the perimeter of the first image. \ 

1 48. The article of claim 25 wherein the perimeter of the first image has the same shape as the 

2 perimeter of the reference image. \ 



-29- 



